From Challenge to Opportunity: Virtual Qualitative Research During COVID-19 and Beyond.

COVID-19 has required researchers to adapt methodologies for remote data collection. While virtual interviewing has traditionally received limited attention in the qualitative literature, recent adaptations to the pandemic have prompted increased discussion and adoption. Yet, current discussion has focussed on practical and ethical concerns and retained a tone of compromise, of coping in a crisis. This paper extends the nascent conversations begun prior to the pandemic to consider the wider methodological implications of video-call interviews. Beyond the short-term, practical challenges of the pandemic, these adaptations demonstrate scope for longer-term, beneficial digitalisation of both traditional and emergent interview methods. Updating traditional interview methods digitally has demonstrated how conversion to video interviewing proves beneficial in its own right. Virtual focus-group-based research during COVID-19, for example, accessed marginalised populations and elicited notable rapport and rich data, uniting people in synchronous conversation across many environments. Moreover, emergent interview methods such as the Grid Elaboration Method (a specialised free-associative method) demonstrated further digitalised enhancements, including effective online recruitment with flexible scheduling, virtual interactions with significant rapport, and valuable recording and transcription functions. This paper looks beyond the pandemic to future research contexts where such forms of virtual interviewing may confer unique advantages: supporting researcher and participant populations with mobility challenges; enhancing international research where researcher presence or travel may be problematic. When opportunities for traditional face-to-face methods return, the opportunity for virtual innovation should not be overlooked.

INTERVIEWER EFFECTS IN LIVE VIDEO AND PRERECORDED VIDEO INTERVIEWING.

Live video (LV) communication tools (e.g., Zoom) have the potential to provide survey researchers with many of the benefits of in-person interviewing, while also greatly reducing data collection costs, given that interviewers do not need to travel and make in-person visits to sampled households. The COVID-19 pandemic has exposed the vulnerability of in-person data collection to public health crises, forcing survey researchers to explore remote data collection modes-such as LV interviewing-that seem likely to yield high-quality data without in-person interaction. Given the potential benefits of these technologies, the operational and methodological aspects of video interviewing have started to receive research attention from survey methodologists. Although it is remote, video interviewing still involves respondent-interviewer interaction that introduces the possibility of interviewer effects. No research to date has evaluated this potential threat to the quality of the data collected in video interviews. This research note presents an evaluation of interviewer effects in a recent experimental study of alternative approaches to video interviewing including both LV interviewing and the use of prerecorded videos of the same interviewers asking questions embedded in a web survey ("prerecorded video" interviewing). We find little evidence of significant interviewer effects when using these two approaches, which is a promising result. We also find that when interviewer effects were present, they tended to be slightly larger in the LV approach as would be expected in light of its being an interactive approach. We conclude with a discussion of the implications of these findings for future research using video interviewing.

Using online technologies to improve diversity and inclusion in cognitive interviews with young people.

BACKGROUND: We aimed to assess the feasibility of using multiple technologies to recruit and conduct cognitive interviews among young people across the United States to test items measuring sexual and reproductive empowerment. We sought to understand whether these methods could achieve a diverse sample of participants. With more researchers turning to approaches that maintain social distancing in the context of COVID-19, it has become more pressing to refine these remote research methods. METHODS: We used several online sites to recruit for and conduct cognitive testing of survey items. To recruit potential participants we advertised the study on the free online bulletin board, Craigslist, and the free online social network, Reddit. Interested participants completed an online Qualtrics screening form. To maximize diversity, we purposefully selected individuals to invite for participation. We used the video meeting platform, Zoom, to conduct the cognitive interviews. The interviewer opened a document with the items to be tested, shared the screen with the participant, and gave them control of the mouse and keyboard. After the participant self-administered the survey, the interviewer asked about interpretation and comprehension. After completion of the interviews we sent participants a follow-up survey about their impressions of the research methods and technologies used. We describe the processes, the advantages and disadvantages, and offer recommendations for researchers. RESULTS: We recruited and interviewed 30 young people from a range of regions, gender identities, sexual orientations, ages, education, and experiences with sexual activity. These methods allowed us to recruit a purposefully selected diverse sample in terms of race/ethnicity and region. It also may have offered potential participants a feeling of safety and anonymity leading to greater participation from gay, lesbian, and transgender people who would not have agreed to participate in-person. Conducting the interviews using video chat may also have facilitated the inclusion of individuals who would not volunteer for in-person meetings. Disadvantages of video interviewing included participant challenges to finding a private space for the interview and problems with electronic devices. CONCLUSIONS: Online technologies can be used to achieve a diverse sample of research participants, contributing to research findings that better respond to young people's unique identities and situations.